Refractive Index of Humid Air in the Infrared: Model Fits 
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The theory of summation of electromagnetic line transitions is used to tabulate the Taylor ex- 
pansion of the refractive index of humid air over the basic independent parameters (temperature, 
pressure, humidity, wavelength) in five separate infrared regions from the H to the Q band at a fixed 
percentage of Carbon Dioxide. These are least-squares fits to raw, highly resolved spectra for a set 
of temperatures from 10 to 25 °C, a set of pressures from 500 to 1023 hPa, and a set of relative 
humidities from 5 to 60%. These choices reflect the prospective application to characterize ambient 
air at mountain altitudes of astronomical telescopes. 

PACS numbers: 51.70.+f, 42.68.-w, 95.85Hp, 92.60.Ta, 41.20.-q 
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I. SCOPE 

The paper provides easy access to predictions of the 
refractive index of humid air at conditions that are typ- 
ical in atmospheric physics, in support of ray tracing [5J 
and astronomical applications [3, EE H3| until experi- 
mental coverage of the infrared wavelengths might render 
these obsolete. The approach is in continuation of ear- 
lier work [46[ based on a more recent HITRAN database 
[60| plus more precise accounting of various electromag- 
netic effects for the dielectric response of dilute gases, as 
described below. 

The literature of optical, chemical and atmospheric 
physics on the subject of the refractive index of moist 
air falls into several categories, sorted with respect to de- 
creasing relevance (if relevance is measured by the close- 
ness to experimental data and the degree of independence 
to the formalism employed here): 

1. experiments on moist air in the visible [3,0, nam, 

2. experiments on pure water vapor at 3.4 and 10.6 

mm m, 

3. experiments on dry air and its molecular con- 



stituents in the visible [6|, [22 

j5lj72L up to 2.0 
[H Sialyl, or at 10.6 ^m 



57 
43 



21, m 



J, at 1.064 
to 1.7 /xm 



4. verification of the dispersion and higher order 
derivatives with astronomical interferometry (7l| . 



5. review formulas [141 1351. 1551. 163j. 

6. theoretical summation of electronic transitions [Tfjl . 

The liquid and solid states of water are left aside, be- 
cause extrapolation of their dielectric response to the 
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gaseous state is difficult by the permanent dipole mo- 
ment of the molecule. Already in the Q band and then 
at sub-millimeter wavelengths [42I Ifjll . 179 ] and eventually 
in the static limit [3], the refractive index plotted as a 
function of wavelength is more and more structured by 
individual lines. Since we will not present these functions 
at high resolution but smooth fits within several bands in 
the infrared, their spiky appearance sets a natural limit 
to the far-IR wavelength regions that our approach may 
cover. 



II. DIELECTRIC MODEL 



A. Methodology 



The complex valued dielectric function n{w) of air 



x 



(i) 



is constructed from molecular dynamical polarizabilities 



1 



1 

u — Lu 0m i — iT m i/2 



(2) 



N m are molecular number densities, S m i are the line in- 
tensities for the transitions enumerated by I. womi are 
the transition angular frequencies, T m i the full linewidths 
at half maximum, c is the velocity of light in vacuum, 
and i the imaginary unit. The line shape ([2]) adheres to 
the complex-conjugate symmetry Xm(^) = X* m (~ ^-0; as 
required for functions which are real-valued in the time 
domain. The sign convention of T m ; merely reflects a 
sign choice in the Fourier Transforms and carries no real 
significance; a sign in the Kramers-Kronig formulas is 
bound to it. The integrated imaginary part is [28j 



/>oo 

/ ^Xm{v)dv = N m y~] 
Jo , 



s, 



ml 



koml 



(3) 



where v = k/(2ir) = uj/{2ttc) = 1/A is the wavenumber. 



2 



Line strengths S m i and positions uj 0m i are based on 
the HITRAN [6(| list (see |6 8|. [6 9l for reviews) and other 
sources as described earlier (46[. The results of Section 
IIVI include summation over the oscillator strengths of the 
air components N2, O2, Ar, Ne, CO2, H2O, O3, CH4 and 
CO. Fig.[T]is an estimate of the combined contribution of 
tracer gases that are missing in this mix of molecules — 
and effectively replaced by the average refractivity of the 
major components — sorted with respect to abundance 
under rather clean environmental conditions. Their elec- 
tromagnetic line lists are taken from 4l[^ 75| for He, [ll[ 
for Kr^ [H for H 2 , 0, [H for N 2 0, [6iffor S0 2) and 
[Hig for NH 3 . 
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7.19] — and often placed as "enhancement factors." See 
[63 | for a review on this subject and [26| for recent values 
of the second virial coefficient. The values presented here 
use the equation of state in a self-consistent solution of 
the first line of [73], Tab. 6.3] for water, the values of [22|, 
p. 239] for Nitrogen, and the NIST values [13] for the 
second and third virials of Oxygen, Argon and Carbon 
Dioxide. 



C. Temperature Dependent Partition Sums 

The temperature dependence of the partition sums 
leads to temperature-dependent line strengths @- For 
the HITRAN lines, this has been implemented on a line- 
per-line basis [25l . |65| . The combined change induced 
by the upgrade to the database of August '06 plus this 
increase of the line strengths at lower temperatures is mi- 
nuscule, less than 2 x 10~ 9 in the co ro f coefficients and 
less than 3 x 10~ 5 K in the cqt coefficients reported in 
Section [TV] 

The line broadening parameters T were not changed 
[33I [70j from the ones at the HITRAN reference pressure 
of 1 atm, since the effect on the real part of the sus- 
ceptibility is presumably negligible. Effects of molecular 
clustering [67 j have not been considered. 



D. Magnetic Susceptibility 



FIG. 1: The combined refractivity of 0.39 Pa He, 0.075 Pa 
Kr, 0.038 Pa H 2 , 0.030 Pa NH 3 , 0.023 Pa N 2 0, and 3.8 x 10" 5 
Pa SO2, is ~ 10 -9 at 12 °C. The dispersion (change in the 
refractivity) across the relevant bands in the IR is ~ 10 -10 . 

The remaining subsections describe some refinements 
of the computer program relative to its status three years 

ago m. 



B. Deviations from Ideal Gas Behavior 

The second virial coefficients for Nitrogen and Oxy- 
gen are negative at typical environmental temperatures, 
« -7.5 x 10" 6 m 3 /mole for Nitrogen and « -1.9 x 1CT 5 
m 3 /mole for Oxygen at 12 °C [H, [jj. More molecules 
are packed into a given volume at a given partial pres- 
sure than the ideal gas equation predicts. The gas densi- 
ties of Nitrogen and Oxygen are ~ 25 mole/m 3 and « 6 



mole/m 3 for Nitrogen and Oxygen, respectively, at air 
pressures of the order 740 hPa, so the correction factors 
for the density and for the refractivity are of the order 
2 x 10~ 4 due to this effect, the product of the virial and 
the density. See [I(| for a review and [l| for examples of 
the crosstalk to refractivities. 

The second and third virials for water vapor are larger 
[liiSi^— the second w -1.3 X 10~ 3 m 3 /mole [z| Fig 



The paramagnetic susceptibility of Oxygen and dia- 
magnetic contribution of Nitrogen [27| account for most 
of the remaining gap between theory and experiment. 
The volume susceptibility of dry air is « 3.7 x 10 -7 [Hj] 
at 1013 hPa, to increase n by sa 1.3 x 10~ 7 . The magnetic 
dipole transitions of Oxygen [l(| HH are incorporated in 
the HITRAN list [l3j, which allows us to add dispersion 
to their response. (Since we are only dealing with the 
limit of small susceptibilities, the electric and magnetic 
susceptibilities are additive, which means cross product 
terms have been neglected here.) The magnetism of wa- 
ter is negligible because the magnetic moment of the wa- 
ter molecule is close to the magnetic moment of the Ni- 
trogen molecule [H, [Hj] , but the abundance of the water 
molecules in air much smaller than the abundance of Ni- 
trogen molecules. 



E. Lorentz-Lorenz Cross Polarization 

We incorporate the mutual inter-molecular cross- 
polarization with the Clausius-Mossotti (Lorentz-Lorenz) 
formula [2(1 HHl: the macroscopic susceptibility \ — 



- 1 in Eq. (J), is 



l-EXm/3' 



(4) 



3 



where X) Xm is the sum over all atomic/molecular po- 
larizabilities. This increases the real part of x by « 
C Xm) 2 /3, hence the real part of n by ps (]T X™) 2 /6, 
which is of the order 2 x 10~ 8 if we take ^ m \ ss 4 x 10~ 4 
as a guideline. 



III. COMPARISON WITH EXPERIMENTS 

The raw theoretical data (prior to the fit) exceeds ex- 
periments for dry air in the visible and near infrared by 
w 4 x 1CT 8 (Fig. [2]). Roughly 0.8 x 1(T 8 of this can 
be attributed to a change in temperature scales Q, and 
roughly 1 x 10 -8 to a presumably lower CO2 contents of 
300 ppmv in 



is 

On 
dp 



= Ci p + 2c lpp (p - p re f) + C t Tp 



i=0,l, 



1 



1 



T T ro f 

+Ci/f p (H - H Te f) {v - V? c i) % (5) 



and generates 0.2618 x 10 8 /Pa at the same wavelength, 
the same temperature, and a pressure — undocumented 
by Marchetti and Simili— of 1013.25 hPa. The relative 
deviation of 6 x 10~ 3 between experiment and theory 
is still compatible with the error 5 x 10~ 3 provided by 
Marchetti and Simili. 

The theory deviates from the humid air data at the 
longest two wavelengths of the Bonsch-Potulski experi- 
ments by 3.5 x 10~ 8 or less: Fig. [HI 
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FIG. 2: Top: The line are the raw data of the theory for dry 
air at 15 °C and 101324 Pa. Circles are the experimental val- 
ues of Table I and II by Peck and Reeder [HHl plus one datum 
at 2.06 /xm by Peck and Khanna [57| . Bottom: Refractive 
index of the theory minus these experimental values. 
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FIG. 3: Lines are the raw data of the theory for humid air 
at 20 °C and 1000 hPa at four levels of humidity. Circles 
are from the Bonsch-Potulski fitting equation (at 370 ppm 
CO2) to their experimental data [9|. The two groups of four 
comparisons refer to the wavelengths 0.5087 and 0.644 /im. 

The difference between the theory and experiments 
with pure water vapor (Fig. 2]) and moist air (Fig. [5]) 
is ps 1 x 10~ 8 at 3.4 /im. 



IV. RESULTS 




The pressure coefficient cq p for dry air at 10 ^tm in 
Table IIVI is to be compared to the value of 2.668 x 
10~ 4 /atm= 0.2633 x 10- 8 /Pa measured at A = 10.57 
^m and T = 23 °C by Marchetti and Simili 0, Tab. 1]. 
More accurately, the pressure gradient predicted from (JT]) 



The bold least squares fit to the raw data — examples 
of which are shown in 0, Figs. 2,12]— looks as follows: 

n - 1 = ^ c i( T ?Pi H ) (v ~ Vi-eiY ; (6) 

i=0,l,2,... 
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FIG. 4: Comparison of the theory (solid line) with the exper- 
imental data by Matsumoto (3 circles) [48], Tab. 1] for water 
vapor of 1333 Pa at 20 °C. 



d(T,p,H) 



+C lH (H - ff ref ) + dHH {H - H Ief f 
+Cip (p - Prel) + Cipp (p - Prcf ) 2 
1 1 



+CiHp (H - if re f) (p ~ Pref) • 



(7) 



Here, T is the absolute temperature with a reference 
value of T ro f = (273.15 + 17.5) K, p is the air pressure 
with a reference value set at p re f = 75000 Pa, H the rel- 
ative humidity between and 100 with a reference value 
set at if r ef = 10 %, and v the wavenumber 1/A with a 
reference value set at z> ro f. The units of these reference 
values match those of the tabulated coefficients. The 
range 1.3-2.5 /im is covered by Table|H the range 2.8-4.2 
fim by Table M the range 4.35-5.3 /jm by Table |TTT1 the 
range 7.5-14.1 //m by Table HVl and the range 16-20 /im 
by Table fVl The refractive index is chromatic (the phase 
shift depends on the wavelength A and wave number v) 
since 



an a \ = —v —— 
av 



(8) 



depends itself on A. (The negative of this parameter, 
measured in radian and divided by the areal molar gas 



FIG. 5: Comparison of the theory (solid line, 300 ppmv CO2) 
with the experimental data by Matsumoto (3 circles) [48], Tab. 
2] for humid air at p = 1013.25 hPa, T = 20 °C and H = 56.98 
%. 



density, has been baptized "normalized dispersion con- 
stant" K in [EI]].) Our simple analytical fit format 
allows rapid calculation of group refractive indices as well 

M- 

The calculation adopts a standard of 370 ppmv of CO2 
as the most likely contemporary ambient clean air stan- 
dard [13, H EL well aware that laboratory air may 
contain a higher volume fraction. Although adding this 
mixing ratio as another free parameter to the procedure 
is feasible, it has been kept fixed here to keep the size of 
the tables in check. 

The use of 1 jT rather than T in the ansatz ([7]) has no 
further relevance but aims to expand the validity of the 
results to a large range of temperatures: in the simplest 
model of the dispersion one expects the susceptibility to 
be proportional to the molecular densities which are — 
with the ideal gas equation — proportional to p/T. This 
reasoning is actually void — as demonstrated by the mag- 
nitudes of CiTT — because we are employing non-infinite 
reference temperatures T re f. 

Solely for the benefit of the reader who may use this 
type of result as a black box, the parameter set in ([7]) is 
based on relative humidity rather than some more fun- 
damental measure of the water molecule number density; 
the more appealing alternative from a scholarly point of 
view would have been to split the computational steps 
into (i) equations to calculate absolute molecular num- 
ber densities, plus (ii) the fitting equations to transform 
these to polarizabilities, and (iii) some post-processing 



5 



TABLE I: Fitting coefficients for the muitivariate Tayior expansion (0 to the real part of the index of refraction over the 
1.3 < 1/5 < 2.5 /im range with v le t = 10 4 /2.25 cm -1 . 





Circf / CHI 


r rr j pm l K 


r^rrrr 1 [ rm ! K 2 l 
l^iTT j [cm l\ J 


^■iH j [cm / /oj 


r titi 1 fern* /% 2 1 
f^iHH j [cm j /o J 





0.200192 x 10" 3 


0.588625 x 10 _1 


-3.01513 


-0.103945 x 10" 7 


0.573256 x 10 -12 


1 


0.113474 x 10 -9 


-0.385766 x 10" 7 


0.406167 x 10" 3 


0.136858 x 10" 11 


0.186367 x 10~ 16 


2 


-0.424595 x 10" 14 


0.888019 x 10" 10 


-0.514544 x 10" 6 


-0.171039 x 10" 14 


-0.228150 x 10 -19 


3 


0.100957 x 10" 16 


-0.567650 x 10" 13 


0.343161 x 10" 9 


0.112908 x 10" 17 


0.150947 x 10~ 22 


4 


-0.293315 x 10" 20 


0.166615 x 10" 16 


-0.101189 x 10" 12 


-0.329925 x 10 -21 


-0.441214 x 10 -26 


5 


0.307228 x 10~ 24 


-0.174845 x 10" 20 


0.106749 x 10" 16 


0.344747 x 10" 25 


0.461209 x 10" 30 


i 


c ip 1 [cm'/Pa] 


Cipp 1 [cm'/Pa 2 ] 


c lTH 1 [cm'K/%] 


c iT p 1 [cm^K/Pa] 


dHp 1 [cmV(% Pa)] 





0.267085 x 10 -8 


0.609186 x 10 -17 


0.497859 x 10" 4 


0.779176 x 10" 6 


-0.206567 x 10 -15 


1 


0.135941 x 10" 14 


0.519024 x 10" 23 


-0.661752 x 10" 8 


0.396499 x 10" 12 


0.106141 x 10~ 20 


2 


0.135295 x 10" 18 


-0.419477 x 10" 27 


0.832034 x 10" 11 


0.395114 x 10 -16 


-0.149982 x 10 -23 


3 


0.818218 x 10 -23 


0.434120 x 10" 30 


-0.551793 x 10" 14 


0.233587 x 10" 20 


0.984046 x 10 -27 


4 


-0.222957 x 10" 26 


-0.122445 x 10~ 33 


0.161899 x 10~ 17 


-0.636441 x 10~ 24 


-0.288266 x 10~ 30 


5 


0.249964 x 10" 30 


0.134816 x 10~ 37 


-0.169901 x 10" 21 


0.716868 x 10" 28 


0.299105 x 10~ 34 



TABLE II: Fitting coefficients for the multivariate Taylor expansion (0 to the real part of the index of refraction over the 
2.8 < 1/5 < 4.2 range with v Ic{ = 10 4 /3.4 cm" 1 . 



i 


c ircf / cm 1 




c lT 1 cm'K 


c lTT j [cm'K 2 ] 


c lH / [cm7%] 


c lHH j [cm7% 2 ] 





0.200049 x 10" 


-3 


0.588431 x 10" 1 


-3.13579 


-0.108142 x 10" 7 


0.586812 x 10" 12 


1 


0.145221 x 10" 


-9 


-0.825182 x 10" 7 


0.694124 x 10" 3 


0.230102 x 10" 11 


0.312198 x 10" 16 


2 


0.250951 x 10" 


12 


0.137982 x 10" 9 


-0.500604 x 10" 6 


-0.154652 x 10" 14 


-0.197792 x 10" 19 


3 


-0.745834 x 10 


-15 


0.352420 x 10" 13 


-0.116668 x 10" 8 


-0.323014 x 10" 17 


-0.461945 x 10" 22 


4 


-0.161432 x 10 


-17 


-0.730651 x 10" 15 


0.209644 x 10" 11 


0.630616 x 10" 20 


0.788398 x 10~ 25 


5 


0.352780 x 10" 


20 


-0.167911 x 10" 18 


0.591037 x 10" 14 


0.173880 x 10~ 22 


0.245580 x 10" 27 


i 


c tp / [cmVPa 




Cipp / [cm'/Pa 2 ] 


c lTH 1 [cm'K/%] 


CiTp 1 [cm'K/Pa] 


dHp 1 [cm7(% Pa)] 





0.266900 x 10" 


8 


0.608860 x 10" 17 


0.517962 x 10" 4 


0.778638 x 10" 6 


-0.217243 x 10 -15 


1 


0.168162 x 10" 


14 


0.461560 x 10" 22 


-0.112149 x 10" 7 


0.446396 x 10" 12 


0.104747 x 10" 20 


2 


0.353075 x 10" 


17 


0.184282 x 10" 24 


0.776507 x 10" 11 


0.784600 x 10" 15 


-0.523689 x 10" 23 


3 


-0.963455 x 10" 


-20 


-0.524471 x 10" 27 


0.172569 x 10" 13 


-0.195151 x 10" 17 


0.817386 x 10" 26 


4 


-0.223079 x 10" 


-22 


-0.121299 x 10" 29 


-0.320582 x 10" 16 


-0.542083 x 10" 20 


0.309913 x 10" 28 


5 


0.453166 x 10" 


25 


0.246512 x 10" 32 


-0.899435 x 10" 19 


0.103530 x 10" 22 


-0.363491 x 10" 31 



with (J4j) . The first step involves a self-consistent adap- 
tation of the components of the dry air at given mixing 
ratios to a partial pressure that is "left over" from p af- 
ter settling for the water density. The philosophy behind 
Equation is to take this kind of burden away. 

The negative values of cqh paraphrase that substitu- 
tion of the "average" dry air molecule by water at fixed 
total pressures p decreases the refractive index in all our 
wavelength regions. 
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TABLE III: Fitting coefficients for the multivariate Taylor expansion (0 to the real part of the index of refraction over the 
4.35 < 1/u < 5.3 fim range with v Te t = 10 4 /4.8 cm -1 . 





Cjrcf / cm 




j ^111 IV 


r -tt 1 \cm i K 2 ] 
t-'iTT j [cm i\ J 


r -ul fern* /%1 
t-zif j [cm j /oj 


r .„„ / [nn, 1 /% 2 1 
f^iHH j [cm j /o J 





0.200020 x 10" 


-3 


0.590035 x 10" 1 


-4.09830 


-0.140463 x 10" 7 


0.543605 x 10" 12 


1 


0.275346 x 10" 


-9 


-0.375764 x 10" 6 


0.250037 x 10" 2 


0.839350 x 10" 11 


0.112802 x 10~ 15 


2 


0.325702 x irr 


12 


0.134585 x 10" 9 


0.275187 x 10 -6 


-0.190929 x 10" 14 


-0.229979 x 10" 19 


3 


-0.693603 x 10 


-14 


0.124316 x 10" 11 


-0.653398 x 10" 8 


-0.121399 x 10" 16 


-0.191450 x 10" 21 


4 


0.285610 x 10" 


17 


0.508510 x 10" 13 


-0.310589 x 10" 9 


-0.898863 x 10" 18 


-0.120352 x 10" 22 


5 


0.338758 x 10" 


18 


-0.189245 x 10" 15 


0.127747 x 10~ n 


0.364662 x 10" 20 


0.500955 x 10~ 25 


i 


c ip 1 [cm* /Pa] 


c ip p 1 [cmVPa 2 ] 


c lTH 1 [cm'K/%] 


OiTp 1 [cm^K/Pa] 


dHp 1 [cm7(% Pa)] 





0.266898 x 10" 


-8 


0.610706 x 10~ 17 


0.674488 x 10" 4 


0.778627 x 10" 6 


-0.211676 x 10" 15 


1 


0.273629 x 10" 


14 


0.116620 x 10" 21 


-0.406775 x 10" 7 


0.593296 x 10~ 12 


0.487921 x 10~ 20 


2 


0.463466 x 10" 


17 


0.244736 x 10" 24 


0.289063 x 10 -11 


0.145042 x 10" 14 


-0.682545 x 10" 23 


3 


-0.916894 x 10 


-111 


-0.497682 x 10" 26 


0.819898 x 10 -13 


0.489815 x 10" 17 


0.942802 x 10" 25 


4 


0.136685 x 10" 


21 


0.742024 x 10~ 29 


0.468386 x 10" 14 


0.327941 x 10~ 19 


-0.946422 x 10" 27 


5 


0.413687 x 10" 


23 


0.224625 x 10~ 30 


-0.191182 x 10" 16 


0.128020 x 10~ 21 


-0.153682 x 10" 29 



TABLE IV: Fitting coefficients for the multivariate Taylor expansion JJ} to the real part of the index of refraction over the 
7.5 < Ijv < 14.1 ^m range with S rof = 10 4 /10.1 cm" 1 . 



i 


Ciref / Cm* 


c lT 1 cm'K 


c lTT 1 [cm'K 2 ] 


c iH 1 [cm*/%] 


dHH 1 [cm7% 2 ] 





0.199885 x 10" 3 


0.593900 x 10" 1 


-6.50355 


-0.221938 x 10" 7 


0.393524 x 10" 12 


1 


0.344739 x 10" 9 


-0.172226 x 10" 5 


0.103830 x 10" 1 


0.347377 x 10" 10 


0.464083 x 10" 15 


2 


-0.273714 x 10~ 12 


0.237654 x 10" 8 


-0.139464 x 10" 4 


-0.465991 x 10~ 13 


-0.621764 x 10" 18 


3 


0.393383 x 10" 15 


-0.381812 x 10" 11 


0.220077 x 10" 7 


0.735848 x 10" 16 


0.981126 x 10~ 21 


4 


-0.569488 x 10" 17 


0.305050 x 10" 14 


-0.272412 x 10" 10 


-0.897119 x 10" 19 


-0.121384 x 10" 23 


5 


0.164556 x 10" 19 


-0.157464 x 10" 16 


0.126364 x 10" 12 
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